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Greedy  approximation  and  the  multivariate  Haar  system1 


A.  Kamont  and  V.N.Temlyakov 

Inst.  Mat.  PAN,  ul.  Abrahama  18,  81-825  Sopot,  Poland 
University  of  South  Carolina,  Columbia,  SC  29208,  USA 

Abstract.  We  study  nonlinear  m- term  approximation  in  a  Banach  space  with  re¬ 
gard  to  a  basis.  It  is  known  that  in  the  case  of  greedy  basis  (like  the  Haar  basis 
H  in  Lp( [0,1]),  1  <  p  <  oo)  a  greedy  type  algorithm  realizes  near  best  m- term  ap¬ 
proximation  for  any  individual  function  (element).  In  this  paper  we  generalize  this 
known  result  in  two  directions.  First,  instead  of  greedy  algorithm  we  consider  weak 
greedy  algorithm.  Second,  we  study  in  detail  unconditional  non-greedy  bases  (like 
the  multivariate  Haar  basis  'Hd  =  H  x  ■  ■  ■  x  H  in  Lp([ 0,  l]d),  1  <  p  <  oo,  p  ^  2).  We 
prove  some  convergence  results  and  also  some  results  on  convergence  rate  of  weak 
type  greedy  algorithms.  Our  results  are  expressed  in  terms  of  properties  of  the  basis 
with  respect  to  a  given  weakness  sequence. 


1.  Introduction 

This  paper  deals  with  nonlinear  to- term  approximation  with  respect  to  a  basis. 
Let  X  be  an  infinite  dimensional  separable  Banach  space  with  a  norm  ||  •  ||  :=  ||  •  ||x 
and  let  T  :=  be  a  normalized  basis  for  X  (||t/>n||  =  1,  n  e  N).  All  bases 

considered  in  this  paper  are  assumed  to  be  normalized.  For  a  given  /  el  we  define 
the  best  to- term  approximation  with  regard  to  T  as  follows 

am(/,  T)  :=  CTm(/,  T)x  :=  inf  \\f  -  V  bk^k ||x, 

bk,  A  z — ' 

k£  A 

where  inf  is  taken  over  coefficients  bk  and  sets  of  indices  A  with  cardinality  |A|  =  to. 
There  is  a  natural  algorithm  of  constructing  an  to- term  approximant.  For  a  given 
element  /  el  we  consider  the  expansion 


(1.1) 


/  =  J^Cfc(/,  $)^fe- 

k= l 


We  call  a  permutation  p,  p(j )  =  kj,  j  =  1,  2, . . . ,  of  the  positive  integers  decreasing 
and  write  p  E  D(f)  if 

|cfcl(/,W)|>|cfc2(/,W)|>...  . 

1This  research  was  supported  by  the  National  Science  Foundation  Grant  DMS  0200187  and 
by  ONR  Grant  N00014-91-J1343 
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In  the  case  of  strict  inequalities  here  D(f)  consists  of  only  one  permutation.  We 
define  the  m-th  greedy  approximant  of  /  with  regard  to  the  basis  'll  corresponding 
to  a  permutation  p  G  D(f )  by  formula 


Gm(f,  *)  :=  G*(f,  4)  :=  C„(/,  ¥,p)  :=  £  ctj  (/,  <6»ky 

3  = 1 

It  is  a  simple  algorithm  which  describes  a  theoretical  scheme  (it  is  not  computation¬ 
ally  ready)  for  to- term  approximation  of  an  element  /.  This  algorithm  is  known  in 
the  theory  of  nonlinear  approximation  under  the  name  Greedy  Algorithm  (see  for 
instance  [T2],  [T3],  [W])  and  under  the  more  specific  name  Thresholding  Greedy 
Algorithm  (TGA)  (see  [T8],  [DKKT]).  We  will  use  the  latter  name  in  this  paper. 
The  best  we  can  achieve  with  the  algorithm  Gm  is 

\\f  -Gm(f,*,p)\\x  =  am(f,*)x, 


or  a  little  weaker 

(1-2)  \\f-Gm(f,*,p)\\x<G<Tm(f,*)x 

for  all  elements  /  G  X  with  a  constant  G  =  C(X,  T)  independent  of  /  and  to.  The 
following  concept  of  greedy  basis  has  been  introduced  in  [KT]. 

Definition  1.1.  We  call  a  basis  T  greedy  basis  if  for  every  f  G  X  there  exists  a 
permutation  p  G  D(f)  such  that 

(1-3)  \\f-Gm(f^,p)\\x<Gam(f^)x 

holds  with  a  constant  independent  of  f ,  to. 

The  first  result  in  this  direction  (see  [T2])  established  that  the  univariate  Haar 
basis  is  a  greedy  basis.  We  remind  the  definition  of  the  Haar  basis.  Denote  %  := 
{Hk}kLi  the  Haar  basis  on  [0, 1)  normalized  in  1,2(0, 1):  Hi  =  1  on  [0, 1)  and  for 
k  =  2n+l,  ra  =  0,l,...,  l  =  l,2,...,2n 

{2n/2,  X  G  [(2/  -  2)2  rz  l,  (21  -  l)2-n-1) 

— 2n/2,  x  G  [(2/  —  1)2  ri1,  2Z2~n~1) 

0,  otherwise. 

We  denote  by  Hp  :=  i  the  Haar  basis  %  renormalized  in  Lp( 0, 1). 

The  following  weak  type  greedy  algorithm  was  considered  in  [T2].  Let  t  G  (0, 1] 
be  a  fixed  parameter.  For  a  given  basis  T  and  a  given  /  G  X  denote  A m(t)  any  set 
of  to  indices  such  that 

(1.4)  min  |cfc(/,T)|  >  t  max  \ck(f,  W)| 
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and  define 

G£‘(/.*'):=  E  <*(/.*)*■ 

Am  (i) 

It  was  proved  in  [T2]  that  in  the  case  of  X  =  Lp,  1  <  p  <  oo,  and  T  is  the  Haar 
system  %  we  have  for  any  f  E  Lp 

(1.5)  ll/-GM/,W)||Ip  <C(p,t)om(f,H)Lr. 

We  note  here  that  the  proof  of  (1.5)  from  [T2]  works  for  any  greedy  basis  instead 
of  the  Haar  system  %.  Thus  for  any  greedy  basis  f  of  a  Banach  space  X  and  any 
t  e  (0, 1]  we  have  for  each  /  el 

(1.6)  11/  -  G£‘(/,  *)||x  <  C(p,  t)am(f,  <t)x. 

This  means  that  for  greedy  bases  we  have  more  flexibility  in  constructing  near  best 
to- term  approximants. 

Recently,  in  the  theory  of  greedy  algorithms  with  regard  to  redundant  systems 
the  Weak  Greedy  Algorithm  with  an  arbitrary  weakness  sequence  r  :=  {ffcjfcli 
has  been  studied  (see  [T7],  [LTe],  [T9]).  In  this  paper  we  study  a  modification  of 
the  above  weak  type  greedy  algorithm  in  a  way  of  further  weakening  the  restric¬ 
tion  (1.4).  We  call  this  modification  the  Weak  Thresholding  Greedy  Algorithm 
(WTGA).  Let  a  weakness  sequence  r  :=  {tk}kLi,  tk  £  [0,1],  k  =  1, . . .  be  given. 
We  define  the  WTGA  by  induction.  We  take  an  element  /  E  X  and  at  the  first 
step  we  let 

Ai(t)  :=  {ni};  T)  :=  cni^ni 

with  m  any  satisfying 

| CnJ  >  ti  max  | cn  | 

n 

where  we  denote  for  brevity  cn  :=  cn(f,  T).  Assume  we  have  already  defined 

Gm_1(/,  *)  :=  4?)  :=  E  c»^' 

n£Am_i(r) 

Then  at  the  mth  step  we  define 

A m(r)  :=  Am_i(r)  U  {nm};  G^(/,  T)  :=  G^’r(/,  T)  :=  ^  cn^n 

n£Am(r) 

with  nm  ^  Am_i(r)  any  satisfying 

|Cnm  I  —  t"m  max  |cn|. 

Thus  for  an  f  E  X  the  WTGA  builds  a  rearrangement  of  a  subsequence  of  the 
expansion  (1.1).  If  T  is  an  unconditional  basis  then  always  G/n(/,  4/)  — *  /*.  It  is 
clear  that  in  this  case  /*  =  /  if  and  only  if  the  sequence  {rik}<^=1  contains  indices 
of  all  nonzero  cn(f,  T).  We  say  that  the  WTGA  corresponding  to  T  and  r  is 
convergent  (converges)  if  for  any  realization  VI/)  we  have 

11/ -  GTm.{f^)\\  ->■  0  as  oo 

for  all  f  EX. 

In  Section  2  we  prove  the  following  three  theorems  on  convergence  of  the  WTGA. 
The  first  one  deals  with  an  arbitrary  Banach  space  X  and  any  basis  T. 
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Theorem  1.  Let  X  be  a  Banach  space  with  a  normalized  basis  T.  Let  r  =  {tn,  n  > 
1}  be  a  weakness  sequence.  The  following  condition  (D)  is  a  necessary  condition 
for  the  WTGA  corresponding  to  T  and  r  to  be  convergent. 

(D)  For  each  subsequence  {n^,  k  >  1}  of  different  indices,  the  series  ffcVw 

diverges  in  X . 

If  the  basis  \F  is  unconditional,  then  the  above  condition  (D)  is  also  a  sufficient 
condition  for  the  WTGA  corresponding  to  \F  and  r  to  be  convergent. 

In  the  case  X  =  Lp([ 0,  l]d)  we  can  derive  from  Theorem  1  a  more  specific  con¬ 
dition  in  terms  of  r. 

Theorem  2.  Let  2  <  p  <  oo,  d  >  1  and  let  ^  be  a  normalized  unconditional 
basis  in  Lp([ 0,  l]d).  Let  r  =  {tn,n  >  1}  be  a  weakness  sequence.  Then  the  WTGA 
corresponding  to  ’3/  and  r  converges  if  and  only  if  r  fflp. 

We  do  not  have  that  simple  criterion  in  terms  of  r  in  the  case  X  =  Lp([ 0,  l]d), 
1  <  p  <  2  and  arbitrary  unconditional  basis  \F.  In  this  case  we  have  the  following 
result  for  the  multivariate  Haar  basis  TLp  defined  as  the  tensor  product  of  the 
univariare  Haar  bases:  TLp  :=  TLP  x  •  •  •  x  TLp.  To  formulate  the  result,  introduce  the 
following  notation.  For  a  sequence  {tk,k  >  1}  of  nonnegative  numbers  such  that 
limfc_>.oo  t k  =  0,  {t*k,k  >  1}  is  a  nonincreasing  rearrangement  of  the  subsequence 
{tnk,  k  >  1}  consisting  of  positive  elements  of  {tk,  k  >  1}. 

Theorem  3.  Let  d  >  1  and  1  <  p  <  2.  The  WTGA  corresponding  to  TLp  and 
a  weakness  sequence  r  converges  in  Lp([ 0,  l]d)  if  and  only  if  one  of  the  following 
conditions  is  satisfied: 

(i)  The  sequence  r  =  {tk}  does  not  converge  to  0. 

(ii)  liiUfe^oo  tk  =  0  and 


(1.7)  £«)2(fc(log*0<I-'))2/''  1=°°- 

k= 2 


Along  with  convergence  of  the  WTGA  we  study  efficiency  of  approximation  by 
GTm{ •,  ’F).  We  compare  accuracy  of  the  WTGA  with  best  to- term  approximation. 
In  the  case  of  greedy  basis  and  r  =  {f},  t  G  (0, 1]  the  relation  (1.6)  shows  that 
G^(-,T)  realizes  near  best  m-term  approximation.  There  are  two  natural  ways  of 
adapting  (1.6)  to  the  case  of  nongreedy  basis  or  to  the  case  of  general  weakness 
sequence.  In  the  first  way  (see  [T5],  [T3],  [W],  [Os])  we  write  (1.6)  in  the  form 

11/  -  Gln(f^)\\  <  C(m,T,A?)am(f,A?) 

and  look  for  the  best  (in  the  sense  of  order)  constant  C(m,r ,  T). 

We  now  formulate  the  correspoding  results.  For  a  basis  T  we  define  the  funda¬ 
mental  function 
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We  also  need  the  following  functions 

<ps(m)  :=  sup  ||Y>||,  <p'(m):=  inf  HV^fell- 

\A\=m  ttA  \A\=m  ^ 


It  is  clear  that 


ip(m)  =  sup  (ps{n). 

n'Cm 


We  now  introduce  some  characteristics  of  a  basis  with  respect  to  a  weakness  se¬ 
quence  r.  For  a  subset  V  C  [l,m]  of  integers  we  define 


0(tj  m,  V)  :=  inf 

{ki} 


E 

iev 


Uipki 


where  inf  is  taken  over  all  sets  {ki}  of  different  indices.  For  two  integers  1  <  n  <  m 
we  define 

0(r,m,n):=  inf  (j)(r,m,V ), 

\V\=n 


and  finally 


/i(r,  to )  :=  sup 

n<m 


ips  (n) 
to,  n) 


We  have  the  following  result. 


Theorem  4.  Let  'F  be  a  normalized  unconditional  basis  for  X .  Then  we  have 

\\f-GTm(f,n\  <C(*)ix(T,m)am(f^). 

In  the  case  r  =  {1}  Theorem  4  is  known.  The  first  result  in  this  direction  was 
obtained  for  the  multivariate  Haar  basis  Tip  (see  [T3]).  Then  it  was  generalized  in 
[W]  for  other  bases,  in  particular,  for  normalized  unconditional  bases.  Moreover, 
it  has  been  proved  in  [W]  that  },to)  is  an  optimal  extra  factor  in  the  above 

inequality  for  r  =  {1}. 

In  Theorem  4  we  compare  efficiency  of  G ^  (-,  T)  with  am(-,  T).  It  is  known  in 
approximation  theory  that  sometimes  it  is  convenient  to  compare  efficiency  of  an 
approximating  operator  which  is  characterized  by  to  parameters  with  best  possible 
approximation  corresponding  to  smaller  number  of  parameters  n  <  to.  We  use  this 
idea  in  approximation  by  the  WTGA.  In  this  paper  we  study  a  setting  when  we 
write  (1.6)  in  the  form 


and  look  for  the  best  (in  the  sense  of  order)  sequence  {vm}  that  is  determined  by 
the  weakness  sequence  r  and  the  basis  T.  We  need  some  more  notation.  Define 

N 

:=  0(t,  N ,  [1,1V])  =  inf  ||  V  tj'ifk  ||. 

- - - 

J=1 


Assume  that  4>{r ,  N )  — >  oo  as  N  — )■  oo  and  denote  vm  the  smallest  N  satisfying 


c f>(r ,  N )  >  2 ip(m). 


We  have  the  following  result  in  this  case. 


6 


A.  KAMONT  AND  V.N.TEMLYAKOV 


Theorem  5.  For  any  normalized  unconditional  basis  T  we  have 

It  is  interesting  to  compare  this  result  with  some  recent  results  from  [DKKT].  It 
has  been  established  in  [DKKT]  that  the  inequalities 

(1-8)  11/  -  GXm(f,  T)||  <  C(tf ,  A )am(f,  ) 


with  fixed  A  >  1  are  characteristic  for  a  special  class  of  bases.  We  describe  this 
class  now.  Let  us  say  that  a  basis  T  is  almost  greedy  if  there  is  a  constant  C  so 
that  for  any  /  G  X 


\\f-Gm(f,m<C  inf 

A>  I A  |  = 


11/  -  5^cfc(/,^)^fc||. 

k£  A 


It  is  clear  that  each  greedy  basis  is  an  almost  greedy  basis.  It  has  been  proved  in 
[DKKT]  that  if  (1.8)  holds  for  some  A  >  1  for  all  /  E  X  then  T  is  almost  greedy. 
It  has  also  been  proved  in  [DKKT]  that  (1.8)  holds  for  any  A  >  1  for  all  f  E  X 
provided  T  is  almost  greedy. 

In  Section  4  we  discuss  the  greedy  properties  of  subsequencies  of  the  Haar  basis 
Ftp  :=  FLP  x  •  •  •  x  Ftp  that  is  a  tensor  product  of  the  univariate  Haar  bases  FL.  It  is 
known  (see  [T2]  and  [T3])  that  FLP  is  a  greedy  basis  for  Lp([0, 1]),  1  <  p  <  oo  and 
FLp  is  a  greedy  basis  for  Lp([ 0,  l]d),  d  >  2  only  for  p  =  2.  Let  M  be  a  subset  of  the 
set  of  indices  neZj.  We  denote 

W^M]  :=  {Hn  p,  n  G  A4}, 

Lp[M\  :=  {/  G  Lp([0,  l]d)  :  (f,Hn)  =  0,  n  £  M}  =  spah{^[M]} 
where  closure  is  taken  in  Lp([ 0,  l]d). 

We  introduce  some  more  notation.  Let  us  define  the  decomposition  of  FLp  into 
dyadic  blocks.  First,  define 

(1.9)  Uo  :=  {1,  2},  and  Us  :=  {n  E  N  :  2s  +  1  <  n  <  2S+1}  for  s  >  1. 

For  s  =  (si, . . . ,  Sd)  we  set 

(1.10)  Us  :=  {n  =  (ni, . . .  ,nd)  :  n*  E  USi  for  i  =  l,...,d}. 


We  note  that  for  each  s  the  supports  of  the  functions  {Hn)P,n  G  Us}  have  the 
same  shape  and  measure  2~lsl,  where  |s|  =  s\  +  ■  ■  ■  +  Sd .  Moreover,  note  that  if 
s  =  (si, . . .  ,  Sd)  with  Si  ^  0  for  all  1  <  i  <  d,  then  #US  =  2lsl  and  the  supports  of 
the  functions  {Hn  pi  n  G  Us}  are  disjoint.  For  general  s  we  have  2lsl  <  #US  <  2lsl+d, 
and  at  most  2d  different  functions  from  {Hn  p,  n  G  Us}  have  the  same  support. 

For  a  positive  constant  K  we  define  two  classes  of  subsequences  A4: 


R(K)  :=  {M  :  Vn  #{s  :  M  D  Us  ^  0,  |s|  =  n}  <  K}; 

J{K)  :=  {M  :  Vs  #{M  n  Us)  <  K}. 

Denote  by  G  (d)  the  set  of  all  subsequences  A4  representable  in  the  form  A4  = 
Mi  U  M2,  Mi  G  R(-Ki),  M2  £  J(K2)  with  some  constants  Ki,  K2. 
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Theorem  6.  Let  Ai  G  G (d).  Thenl-Lp[A4]  is  a  greedy  basis  for  LP[A4\,  1  <  p  <  oo. 

It  is  clear  that  the  condition  Ai  G  G(d)  is  not  a  necessary  condition  for  7ip[A4\ 
to  be  a  greedy  basis  for  LP[A4].  Indeed,  we  can  find  a  sequence  Ai  /  G (d)  with 
disjoint  supports  of  Hn ,  n  G  Ai.  However,  we  will  show  in  Section  4  that  Theorem 
6  is  sharp  in  a  certain  sense. 

In  Section  5  we  present  results  on  relations  between  {crm(f,  TLd)p}  and  {cn(/,  TLp)}- 
We  give  some  embedding  theorems  in  terms  of  the  Lorentz  spaces  and  their  slight 
modifications. 

Let  us  agree  to  denote  by  C  various  positive  absolute  constants  and  by  C  with 
arguments  or  indices  (C(q,p),  Cr  and  so  on)  positive  numbers  which  depend  on  the 
arguments  indicated.  For  two  nonnegative  sequences  a  =  {an}^=1  and  b  =  {6n}^Li 
the  relation  (order  inequality)  an  bn  means  that  there  is  a  number  C(a,b )  such 
that  for  all  n  we  have  an  <  C(a,  b)  bn;  and  the  relation  an  x  bn  means  that  an  <C  bn 
and  bn  «o„. 


2.  The  convergence  results 

We  will  prove  and  discuss  Theorems  1  3  in  this  section. 

Proof  of  Theorem  1.  We  begin  with  the  necessity  part.  Our  proof  is  by  contra¬ 
diction.  Suppose  that  converges  in  X  for  some  sequence  of  different 

indices  { ,  k  >  1).  First,  we  consider  a  special  case.  Let  {n^,  k  >  1}  be  a  sequence 
of  different  indices  such  that  YlkLi  tkrfnh  converges  in  X  and  there  is  a  v  G  N  such 
that  rik  ^  v  for  all  fcGl  Take 


/  V’l'  d-  'y  )  tk'lfrik  ■ 
k=  1 

Then  we  can  take  the  following  realization  of  the  WTGA 


k=  1 

Thus 

OO 

f  -GTm{f,V)  =if„+  tk 

k=m-\- 1 

and  ||  /  —  Gfn{f ,  W)||  -/A  0.  Consequently,  the  WTGA  corresponding  to  ’F  and  r  is 
not  convergent. 

We  now  reduce  the  general  case  to  the  considered  above  special  case.  Let  {n*,,  k  > 
1}  be  a  sequence  of  different  indices  such  that  converges  in  X.  This 

implies  that  lim^oo  tk  =  0,  so  there  is  a  subsequence  {ki,l  >  1}  with  k\  =  1  such 
that 

OO 

<  cx). 

i=i 
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Clearly,  then  both 

OO  OO 

and  E  t'ki'lPnkl  +  1 

1=1  1=1 

converge  in  X ,  and 

OO  OO  OO  OO 

^  '  tk'tpnt  ~  ^  '  tkii>nk,  +  y  '  tki'tPnkl  +  ,  =  ^  ]  tk^sk  ; 


k= 1  Z=1 


Z=1 


fc=l 


where 


J  nfc  if  k  7^  ki  for  all  l  >  1, 

l  nki+ 1  if  k  =  ki  for  some  l  >  1. 


Note  that  {sfe,fc  >  1}  is  a  sequence  of  different  indices  such  that  sk  /  ni  for  all 
k  >  1.  Therefore  we  are  in  the  special  case  considered  above.  This  completes  the 
proof  of  the  necessity  part. 

We  now  proceed  to  the  sufficiency  part.  Our  proof  is  again  by  contradiction. 
Assume  that  T  is  an  unconditional  basis.  Suppose  that  /  e  X  is  such  that 


GTm(f^)  A/ 


in  X .  By  definition, 

m 

G^(/,*)  =EC"»^»* 

k=l 

where 


(2.1)  |cni  |  >  ti  sup  \cn\,  and  \cnk\>tk  sup  \cn\  for  k  >  2. 

n£N  n^n i,... 

As  GTm(f1  T)  7 4  /  and  the  basis  T  is  unconditional,  there  is  yu  e  N  with  ^  0  such 

|c  I 

that  nk  /  /i  for  all  fceN.  This  and  (2.1)  implies  that  <  |"fc|  .  Since  the  basis  ^ 

is  unconditional,  it  follows  that  the  series  Y^kLi  tk^nk  converges  in  X.  Theorem  1 
is  now  proved. 

Remark  2.1  It  is  clear  that  in  the  case  of  TGA  (r  =  {1})  the  condition  (D) 
of  Theorem  1  is  always  satisfied.  However,  the  TGA  may  not  converge  for  some 
bases.  For  instant,  it  was  proved  in  [T5]  (see  also  [CF]  for  1  <  p  <  2)  that  the  TGA 
may  diverge  in  Lp,  p  ^  2  for  the  trigonometric  system.  A  basis  for  which  the  TGA 
converges  is  called  quasi-greedy  basis  ([KT],[W]).  It  is  clear  that  any  unconditional 
basis  is  a  quasi-greedy  basis.  It  is  known  (see  [KT])  that  there  is  a  quasi-greedy 
basis  that  is  not  an  unconditional  basis.  For  other  examples  of  such  bases  see  [DM], 
We  will  prove  one  technical  result  that  we  will  need  later  on.  Let  Xi  =  { mk ,  k  > 
1}  be  a  sequence  of  different  indices,  and  let  r  =  {tk,  k  >  1}  be  a  weakness  sequence. 
Consider  a  new  weakness  sequence  r(M)  =  {r/n,n  >  1},  where 

f  tk  when  n  =  mk  for  k  >  1, 

\  0  otherwise. 

We  have  the  following  corollary  of  Theorem  1. 
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Proposition  2.1.  Let  $  be  a  normalized  unconditional  basis  in  a  Banach  space 
X .  Then  the  WTGA  corresponding  to  T  and  r(M)  is  convergent  if  and  only  if 
WTGA  corresponding  to  $  and  r  is  convergent. 

Proof.  It  is  clear  that  if  r(A4)  does  not  satisfy  the  necessary  and  sufficient  condition 
(D)  from  Theorem  1,  then  r  also  does  not  satisfy  that  condition.  Thus  if  the  WTGA 
diverges  for  r(A4)  it  diverges  for  r.  We  now  prove  that  if  r  does  not  satisfy  (D) 
then  t(M)  also  does  not  satisfy  (D).  Assume  that  Y^kLi  tk'&n.k  converges.  Then 
tk  — *  0  and  we  let  JC  :=  {kj  \JC-i  to  be  such  that  all  kj  are  even  numbers  and 

OO 

ZX-  <  °°- 

3=1 

Then  the  set  £  :=  N  \  JC  is  infinite  and  the  series  a^so  converges. 

We  now  assign  for  the  sequence  r(A4)  to  each  pmk  =  tk,  k  E  £  a  basic  function 
ipnk.  We  split  the  infinite  set  JC  into  a  union  of  two  infinite  sets  JCi  and  JC^.  Then 
we  set  up  a  one-to-one  correspondance  k  k'  between  JC  and  JC\  and  assign  to  each 
Vmk  =  tk,  k  E  JC  a  basic  function  ipn  and  to  different  ry  =  0  we  assign  different 
basic  functions  with  s  E  Uk£K,2{nk}-  Then  the  corresponding  sum  from  the 
condition  (D)  for  the  t(M)  will  be 

'y  '  tklprik  +  y  '  tkfpnki  ■ 

k£C  k£K. 

This  series  converges  and  therefore  r(A4)  does  not  satisfy  (D).  By  Theorem  1  we 
conclude  that  the  WTGA  corresponding  to  r(M)  diverges.  This  completes  the 
proof  of  Proposition  2.1. 

Proof  of  Theorem  2.  Since  T  is  a  normalized  unconditional  basis  in  Lp([ 0,  l]d)  with 
p  >  2,  we  have  for  any  set  {n*,}  of  different  indices 

OO  A  OO  -|  I  OO  ^  I 

||  jNfc^nJIp  >  C'(  /  (^2\tk\2\i/jnk{x)\2)P/2dxSj  P>c(^|tfcr)  P- 

k=  1  i'[0,l]d  k=l  k=  1 

Therefore,  by  the  sufficiency  part  of  Theorem  1  the  WTGA  with  a  weakness  se¬ 
quence  r  converges  if  r  (f  lp. 

Let  us  assume  that  r  G  lp.  Then  it  is  known  (see  [KP])  that  an  unconditional 
basis  T  =  of  Lp([ 0,  l]d),  1  <  p  <  00  contains  a  subsequence  such 

that  each  series  y2T=i  ak'4)nk  converges  provided  {ak}(^=1  G  lp.  Specifying  =  tk 
and  applying  Theorem  1  we  obtain  that  the  WTGA  with  the  weakness  sequence  r 
does  not  converge.  This  completes  the  proof  of  Theorem  2. 

The  case  of  Lp([ 0,  l]d)  with  1  <  p  <  2  is  different  the  condition  on  the  weakness 
sequence  r  depends  now  on  a  particular  unconditional  basis  T.  Let  $  be  a  nor¬ 
malized  unconditional  basis  in  Lp([ 0,  l]d)  with  1  <  p  <  2,  then  for  any  coefficients 
{an}  we  have 


ci(2>„i2) 

n= 1 


00  00  1/p 

'y/j  an'f>n\\p  <  C-2  (5>r) 
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Thus  by  Theorem  1  if  a  weakness  sequence  r  <E  lp,  then  the  WTGA  corresponding 
to  T  and  r  is  not  convergent  in  Lp([0,l]d).  Also,  if  r  ^  l2  then  the  WTGA 
corresponding  to  T  and  r  is  convergent  in  Lp([ 0,  l]d).  In  addition,  as  Lp  ©  I2  is 
isomorphic  to  Lp,  there  is  an  unconditional  basis  T  in  Lp([ 0,  l]d)  (1  <  p  <  2)  for 
which  the  condition  r  ^  I2  is  also  a  necessary  condition  for  WTGA  corresponding 
to  T  and  r  to  be  convergent. 

Let  us  consider  in  detail  the  case  of  the  Haar  system  PLd. 

Proof  of  Theorem  3.  If  r  =  {tk,  k  >  1}  is  a  sequence  of  nonnegative  numbers  which 
does  not  converge  to  0,  then  lim  sup^^  tk  >  0,  and  convergence  of  the  WTGA 
corresponding  to  TLd  and  r  is  an  immediate  consequence  of  Theorem  1. 

It  remains  to  consider  sequences  r  such  that  lim^oo  tk  =  0.  By  Proposition  2.1, 
it  is  sufficient  to  consider  a  sequence  r  with  tk  7^  0.  Introduce  the  notation: 

m  l 

Qm  ■=  #{n  :  |  supp  Hn\  =  2~m},  u0  =  0,  um  =  q5 ,  for  m  >  1. 

3= 0 

Note  that  qm  x  md^12rn  x  um  and  log qm  x  m  x  log  z^n  for  m  >  1.  As  the 
sequence  {tk,  k  >  0}  is  nonincreasing,  we  have  for  um  <  k  <  ZAn+i 

CiKm„f2m{2,p-1)  <  K)2(Miogfc)(1-'i|)2/p_1  <  c2(t:j22^yp-i\ 

which  implies  that 

OO  OO 

(2.2)  X:«)2h(logfc)(1-J,)2/p-1<oo  <=►  00. 

k=  1  m=l 

Let  us  recall  (see  Lemma  3.1  below  for  more  detail)  that  for  any  N  different 
indices  ni, . . .  ,  n/v 

N 

(2.3)  \\J2HmJP  >  C(p,d)(logA0(d~1)(1/2~1/p)^i/p,  1  <  P  <  2. 

i=l 

For  any  sequence  of  different  indices  {n^,  k  >  1} 

OO  OO  OO  Vm  +  l 

=  E  ^Sn^ii2) 

fc— 1  fc— 1  TTl — 0  k — l^m  1 

where  n£  is  such  that  tk  =  t*,*  and  n£  =  n^*.  By  (2.3)  we  continue 

>  C(p,d)(  V  (C^llogfc)^-1)*1/2-1^^)2)  ■  > 

ra=0 

>  C(p,  d)  (  XI  (Ct,  )  V  +  l)d~122m/p)  . 

ra=0 
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Thus,  it  follows  from  (2.2)  and  Theorem  1  that  if  a  weakness  sequence  r  satisfies 
the  condition  (1.7),  then  the  WTGA  corresponding  to  TLp  and  r  converges. 
Suppose  now  that 

OO 

(2.4)  X>£)2(S,'(log*)(I-‘<))2/'"1  <  «>• 

k=  1 

Take  a  sequence  {n^,  k  >  1}  of  different  indices  satisfying 

|  supp  HUk  P\  =  2~m  for  vm  +  1  <  k  <  vm+i, 


i.e.  we  order  the  functions  Hnp  according  to  the  measure  of  their  supports  (more 
precisely,  the  sequence  of  measures  |  supp  HnkjP\  is  nonincreasing).  Then,  using 
unconditionality  of  Up,  we  obtain 


oo  n  oo  ^  j  2 

II?  <  c-(p.rf)  /  (El^-pMI2)  dx 

/OO  + 1  p/2 

(EK.t i)2  E  iff-»,rwr)  dx 

thl]d  m=  1  k=um+l 

OO 

<C(p,d)('£K„+i)\m  +  l)d-1 


m— 0 


The  above  inequality  combined  with  Theorem  1  and  (2.2)  implies  that  for  r  satis¬ 
fying  (2.4)  the  corresponding  WTGA  is  not  convergent. 


3.  Proof  of  Theorems  4  and  5 

This  proof  uses  an  idea  from  [T2].  The  following  proposition  is  a  well  known 
fact  about  unconditional  bases  (see  [LT],v.I,  p.19). 

Proposition  3.1.  Let  T  be  an  unconditional  basis  for  X .  Then  for  every  choice 
of  bounded  scalars  {Afc}£Ep  we  have 

OO  OO 

II  ^2  Xkak^k\\  <  K  sup  |  Afc  1 1 1  ak'f’k 1 1 • 

k= 1  k  k=  1 

Take  any  e  >  0  and  find 

Pm(f)  ■=  bk^k 

k£P 

such  that  \P\  =  m  and 


(3.1) 


11/  -Pm(/)||  <  tTm(/,  41)  +€. 
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For  any  finite  set  of  indices  A  we  denote  S a  the  projector 

Sa(/)  :=£>*(/,#)*. 

k£  A 


Proposition  3.1  implies  that 

(3-2)  ||/-M/)||  <K(vm{f,*)+e). 


Let 

Gw(/,  * )  =  E  <*{/,  *)*  =  5g(/). 

k£Q 


Then 


(3.3)  ||/  -  G]v(/,  T)||  <  ||/  -  5P(/)||  +  ||5P(/)  -  50(/)||. 

The  first  term  in  the  right  side  of  (3.3)  has  been  estimated  in  (3.2).  We  estimate 
now  the  second  term.  We  have 


(3-4)  SP(f)  -  SQ(f )  =  SP\Q(f)  -  SQ\P(f). 

Similarly  to  (3.2)  we  have 

(3.5)  \\SQ\Pm<K(am(f,*)+e). 

We  now  estimate  ||Sp\q(/)||.  Let  J  be  the  set  of  indices  %  such  that  elements  of 
P  H  Q  where  chosen  at  steps  i  6  J .  Denote 

a:=  max  |cfc(/,  T)|. 
k£P\Q 

Then  from  the  definition  of  the  WTGA  we  obtain  that 

sQ\p(f)=  ckif^)^k 

k£Q\P 

and  {cfc(/,  ^)}k£Q\p  can  be  enumerated  by  indices  *  £  V  :=  [1,  N]  \  J  in  such  a 
way  that 

\ckdf,  ’L)|  >  Ua,  ieV. 

Then  by  Proposition  3.1  we  have 

(3-6)  ||'S'q\p(/)||  >  K~1a(f)(T,  N,V) 

and 


(3.7) 


Sp\g(/)l|  <  KaV‘(\P\Q\). 
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Thus  in  the  case  of  N  =  m  (Theorem  4)  denoting  n  :=  \P  \  Q\  =  \Q  \  P\  we  get 

K2p(r,m)\\SQ\P(f)\\. 

In  the  case  of  N  =  vm  (Theorem  5)  we  obtain 

(3.8)  0(r,  N,  V )  >  4>{t,  N)-\\yt  Uifki\\  >  0(t,  N)  -  <p(m)  >  <p(m). 

i£j 


Combining  (3.6)  (3.8)  we  get 

WSP\Q(f)W<K2\\SQ\P\\. 

It  remains  to  substitute  this  inequality  and  the  inequality  (3.5)  into  (3.4)  and  use 
(3.3). 

Theorems  4  and  5  are  proved. 

Let  us  make  some  comments  on  Theorems  4  and  5.  First  we  consider  the  case 
when  T  is  a  greedy  basis.  Then  by  Definition  1.1  we  have  (1.3)  satisfied.  Let  us 
see  what  Theorem  4  gives  in  this  case.  We  remind  one  result  from  [KT], 

Definition  3.1.  We  say  that  a  normalized  basis  T  =  {^k}kLi  is  a  democratic 
basis  for  X  if  there  exists  a  constant  D  :=  D(X,  T)  such  that  for  any  two  finite 
sets  of  indices  P  and  Q  with  the  same  cardinality  \P\  =  \Q\  we  have 

(3.9)  ||^*ll 

k£P  k£Q 


The  following  theorem  was  proved  in  [KT], 

Theorem  3.1.  A  normalized  basis  is  greedy  if  and  only  if  it  is  unconditional  and 
democratic. 

Thus  by  Theorem  3.1  we  have  (3.9)  satisfied  for  a  greedy  basis.  It  is  easy  to  see 
that  (3.9)  implies  ips(m)  <  D(j>{m )  and  therefore  for  r  =  {1}  we  get  p({l},m)  <  D. 
This  means  that  Theorem  4  states  that  for  any  greedy  basis  T  we  have  (1.3)  for 
any  p  £  £>(/). 

We  now  apply  Theorems  4  and  5  in  the  case  of  T  =  1  <  p  <  oo  with  the 

weakness  sequence  r  =  {1}.  We  will  use  the  following  known  inequalities. 

Lemma  3.1.  Let  1  <  p  <  oo.  Then  for  any  A,  |A|  =  m,  we  have  for  2  <  p  <  oo 


i/p 


min  ||cnifn|L  < 

n£A 


V  cnHn\\p  <  Cp  dm1/p (log m)hM  max  ||cn#n||p, 

z — '  n£A 

n£A 


and  for  1  <  p  <  2 

Cp  dm1/p(logm) ~h(p’d)  min  ||cniLn||p  < 

n£A 


y  '  cnHn  ||p  A  Cp  dm  max  ||cniLn||p 

z — '  n£A 

n£A 
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where  h(p,  d )  :=  (d  —  1)  1 1/2  —  l/p\. 

Lemma  3.1  in  the  case  d  =  2,  4/3  <  p  <  4  has  been  proved  in  [T3]  and  in  the 
general  case  in  [W].  Lemma  3.1  implies  that  for  1  <  p  <  oo 

/?({l},m)  x  C(p,  d)(log  m)(d_1)l1/2_1/pl 

and 

um  x  C(p,  d)m(logm)(-d_1^p/2_1L 
Therefore  Theorem  4  gives  the  known  result  (see  [T3],  [W]) 

(3.10)  ||/  -  Gm{f,Up) ||p  <  C'(p,d)(logm)(d_1)|1/2_1/p|c7m(/,^p)p,  1  <p  <  oo. 

Theorem  5  gives  a  new  result.  We  note  that  for  functions  /  with  slow  decay  of 
crm(f, 7-Lp)p  Theorem  5  gives  a  better  estimate  than  (3.10).  Consider  for  example 
°m{f,l-Lp)p  ~  m  01 .  Then  (3.10)  gives 

(3.11)  ||/ -  Gm(f,Up)\\p  <C  (logm)(d~1)|1/2~1/p|m~a,  1  <  p  <  oo 

while  Theorem  5  gives 

(3.12)  ||/ -  Gm(f,Up)\\p  <C  (m(logm)_(d_1)|p/2_1|)_aJ  1  <  p  <  oo. 

For  a  <  1/p  the  estimate  (3.12)  is  better  than  (3.11). 

Theorem  3.2.  Let  X  be  a  Banach  space  with  a  normalized  unconditional  basis  T. 
Let  r  =  {tn,n  >  1}  be  a  weakness  sequence  such  that  the  WTGA  with  respect  to  T 
and  r  is  convergent.  Let  {vm,m  6  N},  be  a  sequence  of  natural  numbers,  vm  >  to. 
Then  the  following  two  conditions  are  equivalent. 

(i)  There  is  a  constant  C  such  that  for  each  pair  of  natural  numbers  n  <  m  and 
any  set  V  C  [l,um],  |V|  =  vm  —  m  -f  n  we  have  the  following  inequality 

II II  <  cW^u^kiW 

j£A  i£V 

for  any  two  sets  of  indices  A  and  B  :=  {ki,i  G  V}  ( all  ki,  i  G  V  are  different) 
satisfying  the  conditions:  Af]  B  =  0  and  \A\  =  n. 

(ii)  There  is  a  C  >  0  such  that  for  all  f  G  X 

(3-13)  \\f-GlJf,n\<Cam(f^). 

Proof.  The  implication  (?)  =>•  (ii)  can  be  proved  in  the  same  way  as  Theorem  5. 
We  will  not  dwell  on  it  here.  We  only  note  that  we  use  (i)  with  A  =  P  \  Q  and 
B  =  Q  \  P  to  get  from  the  following  analogs  of  (3.6)  and  (3.7) 

||SQVp(/)||  >  K^aW  Y,  U'll’kt  ||,  B  =  {ki,i  G  C} 

i&V 


(3.14) 
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(3.15)  I|Sp\q(/)||  <  Ka\\  t/>„|| 

n£A 

the  inequality 

\\SP\Q(f)\\<CK2\\SQ\p(f)\\. 

We  now  prove  that  (ii)  (i).  Let  a  pair  of  n  <  m  be  given  and  let  V,  A ,  B 
be  any  sets  satisfying  the  conditions  of  (i).  Let  Y  be  such  that  |F|  =  m  —  n  and 
A  n  Y  =  0  and  B  PI  Y  =  0.  Consider 


f  ■=  + 

neAUF  i£V 

We  take  the  following  realization  of  the  WTGA.  For  steps  i  G  V  we  take  rq  =  k<, 
and  for  steps  i  ^  V  we  take  different  rq  G  1".  Then  we  get 


This  implies  by  (ii)  that 


II  £lM|  =  ll/-GU/,*)ll  <  Cam(f,V)  <  ||  JU*. 

n£A  i£V 

This  completes  the  proof  of  Theorem  3.2. 


Let  us  make  some  more  comments  on  Theorems  4  and  5.  From  the  definition 
of  99s  (to)  and  0(m)  we  get  immediately  that  99s  (to)  <  Cm<f)(m )  and  therefore 
/i({l },m)  <  Cm.  Thus  by  Theorem  4  for  any  normalized  unconditional  basis  T  we 
have 

||/-Gra(/,¥)||  <C(»K(/,$). 


We  will  now  construct  an  example  of  a  Banach  space  Af  and  unconditional  basis  T 
such  that  Theorem  5  does  not  hold  even  for  the  TGA  (r  =  {!})• 

Example  3.1  Let  X  be  the  space  of  sequences  a  =  ( am;n;n,  m  >  1)  with  the 
norm 


a 


OO  OO  ..  / 

:=E(Ei“™."i”)  <«>• 

n=l  m=l 


Let  T  =  {V’fc,;}  where  tpk,i  ■=  (d(m,n),(k,i)',n,m  A  1)-  Clearly,  T  is  an  unconditional 
basis  of  Af.  Therefore  the  TGA  corresponding  to  T  converges.  However,  observe 
that  there  is  no  sequence  {vm,m  >  1}  for  which  condition  (i)  of  Theorem  3.2  is 
satisfied.  To  see  this,  consider  Am  :=  {( k ,  1)  :  k  =  1, . . .  ,m}  and  B^n  =  {(l,n)  : 
1  =  1,...  ,  /i}.  Then  for  each  m 


while  for  each  fi 


inf 


^2  ^ k,i 


k= 1 


=  m , 


lim 

n— >•  oo 


E 

fc=i 


^Pk,r 


lim  /r1/n 

n— >•  oo 


l. 


By  Theorem  3.2  there  is  no  sequence  {um,m  >  1}  such  that  the  inequality  (3.13) 
holds  with  a  constant  C  independent  of  both  a  G  X  and  m. 
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4.  Greedy  subsequences  of  the  multivariate  Haar  basis 

It  is  well  known  that,  for  p  ^  2  and  d  >  2  the  d-variate  tensor  product  Haar 
system  PLp  is  not  a  greedy  basis  in  the  corresponding  Lp([ 0,  l]d)  space.  However,  for 
some  functions  the  Thresholding  Greedy  Algorithm  may  give  an  order  of  approxi¬ 
mation  comparable  with  the  order  of  best  approximation.  In  this  section  we  address 
the  question:  For  what  functions  the  TGA  realizes  near  best  to- term  approxima¬ 
tion?  Let  us  recall  that  for  s  =  (si,...  ,Sd),  the  dyadic  block  Us  is  defined  by 
(1.10),  and  the  Haar  functions  Hnp  with  n  G  Us  have  the  same  shape  of  supports. 

We  are  interested  in  the  influence  of  some  ”  structural  constrains”  imposed  on  a 
function  on  the  efficiency  of  TGA  with  respect  to  the  Haar  system  PLp.  By  ’’struc¬ 
tural  constrains”  we  mean  constrains  imposed  on  the  number  of  nonzero  coefficients 
in  dyadic  blocks  or  on  the  number  of  dyadic  blocks  with  nonzero  coefficients.  These 
constrains  are  expressed  in  terms  of  classes  of  sequences  R (K),  J  (K),  and  G (d) 
(see  the  Introduction).  We  begin  with  proving  Theorem  6. 

Proof  of  Theorem  6.  For  any  sequence  A4  the  system  T-Lp[AA]  is  an  unconditional 
basis  for  Lp[ A4],  1  <  p  <  oo.  Thus  by  Theorem  3.1  it  is  sufficient  to  establish  that 
TLp[Ai\  is  democratic  provided  A4  G  G (d).  This  follows  from  Lemmas  4.1  and  4.2 
below. 

Lemma  4.1.  Let  1  <  p  <  oo  and  A4  G  R (K) 

A4  we  have 

m 

II  Hnk  P\\p  ; 

k=  1 

with  constants  depending  on  K  and  p. 

Lemma  4.2.  Let  1  <  p  <  oo  and  AA  G  J (K).  Then  for  any  different  ni, . . . ,  nm  C 
A4  we  have 

m 

\\\^  H  II  ^  m1^ 

||  /  11nk,p\\p  —  "I 

k=  1 

with  constants  depending  on  K  and  p. 

In  the  case  d  =  1  Lemma  4.1  with  A4  =  N  was  proved  in  [T2].  That  same  proof 
works  for  d  >  2  under  assumption  A4  G  R (K).  Let  us  prove  Lemma  4.2. 

Proof  of  Lemma  f.2.  We  recall  (see  Lemma  3.1)  that  by  the  Littlewood-Paley 
theory  we  have 


Then  for  any  different  ni, . . . ,  nm  C 
mi/p 


5^Rnfe,p||P  <  C{p,d)m1/p  for  l<p<2 
k=  1 


and 

m 

C(p,  d)m1/p  <  ||  Hnk,p\\p  for  2  <  p  <  oo 

k=  1 
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for  any  different  ni,...,nm.  To  prove  the  upper  estimate  in  case  2  <  p  <  oo, 
we  use  the  following  inequality,  which  is  a  special  case  of  Lemma  2.3  of  [Tl] :  for 
2  <  p  <  oo  and  /  =  £s  fs  with  fs  =  cn{f)Hn 

(4.1)  ll/llP<CI;,J(J](2l>l(1/2-1/»)||/,||.2)!,)1/P 


For  each  s,  let  ms  be  the  number  of  n^’s  in  Us.  Note  that 


£  Hm,„  ||2  = 

k:n  keUs 


and  therefore  by  (4.1) 


m  .  , 

Y.H«^Wv<Cp4{Y.<'2)  ”• 


Taking  into  account  that  m  =  J2sms  and  ms  <  K  by  assumption  A4  G  J(ib)  we 
get 

m 

II  Hnk,p\\p  <  Cp4m1/p  for  2  <  p  <  oo 

k=  l 

with  the  constant  depending  only  on  p  and  K. 

To  complete  the  proof,  recall  that  the  lower  estimate  in  the  case  1  <  p  <  2 
follows  from  the  upper  estimates  for  all  2  <  p  <  oo  by  duality.  Using  the  Holder 
inequality  we  obtain 

m  m 

(£  '  £  Hnk,p'  (x))dx 

k= 1  k= 1 

m 

—  II  Hnk,p\\p  ■  ||  Hn ky  lip'  iCm1^  || 

k=  1  fc=l  fc=l 

which  gives  the  lower  estimate  in  case  1  <  p  <  2  with  a  constant  depending  only 
on  p  and  AA 

This  completes  the  proof  of  Theorem  6. 

We  now  proceed  to  a  discussion  of  in  what  sense  Theorem  6  is  sharp.  We  need 
some  more  notation  describing  the  structural  constrains  on  functions. 

Let  A  =  {As,  s  =  (si, . . .  ,  Sd)  G  Z+}  be  a  sequence  of  integers,  satisfying 

(4.2)  0  <  As  <  #US. 

Denote 

V(A)  :={M:\MnUs\<  As}. 


m  = 


£ 

k.= i ' 


[o,i]c 


Hnk,p{x)  ■  Hnk  pi  (x)dx  — 


'[0,1]“ 
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For  1  <  p  <  oo  consider  the  following  sets  of  functions 

(4.3)  L„(A)=  |J  LP[M], 

M6V(A) 

i.e.  Lp( A)  consists  of  /  G  Lp([ 0,  l]d)  with  at  most  As  non-zero  coefficients  in  blocks 
Us,  s  G 

We  describe  a  distribution  of  As’s  for  a  given  sequence  A  by  defining  for  nonneg¬ 
ative  integers  /q  M 

(4.4)  <Vm( A)  :=  #{s  :  |s|  = /i  and  As  >  M}. 

Now,  let  A  :=  {u^m}  be  a  sequence  of  nonnegative  integers  satysfying  the 
conditions 

(4.5)  <  aM,M2  for  Mi  >  M2 

(4.6)  0^,0  =  #{s  =  (si, . .  -  ,  sd)  :  |s|  =  //},  =  0  for  M>max#C/s. 

|s|=/i 

Let  us  note  that  the  sequence  {okm,a^  (A) }  defined  above  satisfies  these  conditions 
for  any  A. 

To  formulate  the  main  result  of  this  section,  we  define  a  type  of  a  sequence  A 
and  full  range  sequences. 

Definition  4.1.  Let  A  =  {clP:m}  be  a  sequence  satisfying  (4-5)  and  (4-6),  and  let 
A  =  {As}  be  a  sequence  of  integers  satisfying  (4-2).  A  is  called  a  type  A  sequence 
if  an,M  {A)  =  for  all  /q  M  >  0  (where  ckm,m( A)  is  given  by  formula  (4-4))- 

Definition  4.2.  Let  A  =  {aP:M}  be  a  sequence  satisfying  ( 4-5 )  and  (4-6).  The 
sequence  A  is  called  a  full  range  sequence  if  for  each  M  >  0  we  have 
limsup  =  oo. 

Let  us  take  a  sequence  A4  G  G(cl)  and  define 

<V,m(A4)  :=  #{s  :  |s|  =  p,  and  #(A4  n  Us)  >  M}. 

From  the  definition  of  G (d)  we  get  that 

M  =  Mi  u  M2,  Mi  e  R{I<i),  M2  e  3{I<2). 

Thus  for  M  >  K2  we  have  aM)M(A4)  <  Ki.  Therefore  any  M  G  G (d)  has  a 
distribution  that  is  not  a  full  range  sequence.  It  follows  from  the  Definition  4.2 
that  the  opposite  is  also  true:  if  {aPjM{M)}  is  not  a  full  range  sequence  then 
M  G  G(d).  Theorem  4.1  below  states  that  if  constrains  on  the  structure  of  a 
function  are  given  in  terms  of  the  distribution  sequence  {aP:M  (A4)}  then  Theorem 
6  is  the  best  possible. 
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Theorem  4.1.  Let  A  =  {g-^m }  be  a  sequence  satisfying  (4-5)  and  (4-6).  Let  d  >  2, 
1  <  p  <  oo,  p  ^  2.  Then  the  following  conditions  are  equivalent: 

(i)  A  is  not  a  full  range  sequence. 

(ii)  There  is  a  constant  C  =  C(A,d,p )  (depending  only  on  A,  d  andp)  such  that 
for  each  A  =  { As ,  s  =  (si, . . .  ,  Sd )}  of  type  A  we  have  for  all  f  E  Lp( A)  and  to  E  N 

(4.7)  \\f  -  Gm(f,Hdp)\\p  <  Cvm(f,Hdp). 


Proof.  The  implication  (?)  =X  (ii)  follows  from  Theorem  6.  We  now  prove  that 
(ii)  =>•  (i).  For  any  given  sequence  A  of  a  full  range  we  will  construct  a  A  of  type 
A  such  that  (4.7)  does  not  hold.  We  begin  with  a  construction  which  will  provide 
us  with  building  blocks  of  the  counterexample  sequence  Ad.  This  construction  is  a 
modification  of  a  construction  from  [6, Section  4], 

For  a  given  pair  of  natural  numbers  k  and  l  such  that  l  <  k  we  consider  the 
following  special  polynomials.  First,  we  define  a  set 

I(k,  l )  :=  {s  :  |s|  =  kd ,  Sj  >  k  —  l,  j  =  1, . . . ,  d}. 

Then 

#/(fc,/)x/d-1. 

Consider  the  cube  [0,  2l~k)d  and  define 

Us(k,l)  :=  {n  :  n  G  Us  and  supp  Hn  C  [0,  2l~k)d}; 

E(k,l)  :=  U sei(k,i)Us(k,l). 

Define  a  polynomial 

9k,1  := 

n  £E(k,l) 

By  the  Littlewood-Paley  theory  we  have 

(4-8)  IIsjmIIp  -  ll(  l#n,p(z)|2)1/2||p,  l<p<oo. 

n€i  E(k,l) 

The  supports  of  J2n£Us{k  i)  Hn,p,  s  G  I(k,  l )  cover  the  cube  [0,  2l~k)d  and  therefore 
we  obtain  from  (4.8) 

(4.9)  ||^,i||Px2id/PZ(d-1)/2. 

The  number  to  :=  m(k,  l )  of  terms  of  the  polynomial  satisfies  the  inequalities 

(4.10)  C'i(d)/(d-1)2id  <  to  <  C2(d)l^-1hld. 


Let  us  take  a  companion  to  the  polynomial 

m 

hm  •—  ^  ^  Hn i  ? 


i—  1 
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such  that  n;  ^  E(k ,  l),  i  =  1, . . . ,  m  and 

supp  Hn .  n  supp  Hn.  =0,  i  /  j. 

Then 

(4.11)  \\hm\\p  ~  m1/p. 

Considering  the  function  /  :=  gk,i  +  2hm  in  the  case  2  <  p  <  oo  and  the  function 
/  :=  i  +  hm  in  the  case  1  <  p  <  2  we  will  get  for  an  A4  containing  E(k,  l )  and 
{m}£i  ’ 

||/-Gm(/,^[X])||p/«rm(/,^[A(])p»(logm)(<'-1)'1/>-1/2'. 

Let  A  be  a  full  range  sequence.  Then  there  is  an  increasing  sequence  {/q}  such 
that 

(4.12)  a^2ld  >  2C'2(d)/((i-1)2w. 

We  define 

X:= 

where  is  such  that 

(4.13)  suppiLnj  C  [1/2, 1) d  and  suppiLn.  flsuppiLnj  =0,  i  /  j. 

It  is  clear  that  {n^}?^  with  the  properties  (4.13)  can  be  chosen  in  a  way  that  A4 
will  be  of  type  A.  This  completes  the  proof  of  Theorem  4.1. 

We  note  that  the  above  argument  implies  even  more. 

Proposition  4.1.  Let  A  =  {u^m}  be  a  full  range  sequence  and  d  >  2,  1  <  p  <  oo. 
Let  {C(m,A,d,p),m  G  N}  be  a  sequence  of  reals  such  that  for  each  A  =  {As}  of 
type  A,  f  G  Lp( A)  and  to  G  N 

||/  -  Gm(f,  LLp)\\p  <  C(m,A,P)am(f,ndp)p. 

Then 

C(m,A,d,p)  x  (logm)^-1^1/2-1/35!. 

5.  Some  direct  and  inverse  theorems  in 

TO-TERM  APPROXIMATION  WITH  REGARD  TO  TLp 

In  the  case  d  =  1  the  Haar  basis  is  a  greedy  basis  for  Lp,  1  <  p  <  oo.  The 
following  characterization  theorem  has  been  established  in  [T3]  (for  the  case  p  =  2 
see  [St],  [DT]).  We  will  use  the  notation 

an{f,p)  ■=  | cfc„(/,ftp)| 

for  the  decreasing  rearrangement  of  the  coefficients  of  /. 
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Theorem  5.1.  Let  1  <  p  <  oo  and  0  <  q  <  oo.  Then,  for  any  positive  r  we  have 
the  equivalence  relation 

OO  OO 

m= 1  n=l 

Let  us  remind  the  definition  of  the  Lorentz  spaces  of  sequences  and  introduce 
new  spaces  which  provide  finer  (logarithmic)  scale.  Let  for  a  sequence  {ccfej^Lj  a 
sequence  be  a  decreasing  rearrangement 

\xp(i)\  >  \xp(2)\  >  • 

For  r>0,  0<g<oo  denote 

OO 

r,-.=  {M?_i :  E  Km\,kr^1  < 

k=  1 

or,  equivalently, 

OO 

s= 0 

For  r  >  0,  6  6  R,  0  <  q  <  oo  define 

OO 

r/  :=  {{xt}r=l  :  <  «>}• 

s= 1 

It  is  clear  that  £]f0  =  lrq. 

The  proof  of  Theorem  5.1  was  based  on  the  following  two  lemmas. 

Lemma  5.1.  For  any  two  positive  integers  N  <  M  we  have 

aM(f,P )  <  C(p)aN(f,n)p(M-N)-1/F 
Lemma  5.2.  For  any  sequence  mo  <  mi  <  . . .  of  nonnegative  integers  we  have 

OO 

Vms{f,FL)p  <  C{p)^2ami{f,p)(mi+1 

i=s 

We  will  prove  in  this  section  the  following  multivariate  analogs  of  the  above 
lemmas. 

Lemma  5.3.  For  any  two  positive  integers  N  <  M  we  have 

aM(f,P )  <  C(p,d)aN(f,nd)p(M  -  N)-1^,  2  <  p  <  oo; 

aM(f,p)  <  C(p,d)aN(f,nd)p(M  -  N)-^{\ogM)h^d\  1  <p  <  2 

with  h(p ,  d)  :=  (d  —  1) 1 1/2  —  l/p|. 
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Lemma  5.4.  For  any  sequence  mo  <  mi  <  . . .  of  non-negative  integers  we  have 

OO 

Vma{fi'Hd)p  <  C{p,d)^2ami(f,p){mi+1  -  mi)1/p  (log  mi+1)hM ,  2  <  p  <  oo; 

i=s 

oo 

Vms{f-,TLd)p  <  C(p,d)^2ami{f,p){mi+1  -  rm)1/p,  1  <  p  <  2. 

i=s 

Proof  of  Lemmas  5.3  and  5-4 ■  These  two  lemmas  follow  from  the  well-known  in¬ 
equalities 

C1(p,d)(Y/\\cnHn\\Pp')1/Pl  <  \\Y,CnHn\\p  <  C2(p,d)(Y,\\CnHn\\Ppu)1/PU 

n  n  n 

where  1  <  p  <  oo  and  pi  :=  max(2,p);  pu  :=  min(2,p),  and  from  Lemma  3.1. 

Using  Lemmas  5.3  and  5.4  one  can  establish  the  following  embedding  theorem 
in  the  same  way  as  Theorem  5.1  was  deduced  from  Lemmas  5.1  and  5.2  in  [T3] . 

Theorem  5.2.  Let  1  <  p  <  oo.  Denote 

°{f)p-={°rn{f,'Hd)p}™=  i  and  a(f,p):={an(f,p)}^=1. 

Then  we  have  the  implications: 

(5.1)  »(/),e(;‘  =>  a(f,p)  2<p<oo; 

(5.2)  oU)rer-b  =s.  a(f,p)er+1/<‘-b-hM,  l<p<2; 

(5.3)  a(f,p)er+1/”-b  =>  a(f)r  e  C*-^,  2  <  p  <  oo; 

(5.4)  «(/,p)  eC1/p,i>  =*•  1<P<2. 

Let  us  discuss  in  more  detail  the  implication  (5.1).  We  want  to  understand  what 
smoothness  classes  are  natural  for  m-term  approximation  with  regard  to  the  basis 
TLd  which  is  a  tensor  product  of  the  univariate  Haar  basis  TL.  We  consider  the 
relation  a(f,p)  G  £q+1^p,b  for  a  special  choice  of  h  =  0  and  q  =  £  :=  (r  +  l/p)_1. 
Then  a(f,p)  G  £q+1^p  is  equivalent  to  ^2nan(f,p)^  <  oo  or 

(5.5)  ||cn(/)#n||p  <  oo  where  /  =  ^cn(/)#n- 

n  n 

Next,  we  have  for  n  G  Us 

\\Cn(f)Hn\\p  =  ||Cn(/)^n|k2-|BK1/P-1/«  =  |  |cn  (f)Hn  |  |?2^ISI . 
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Thus  (5.5)  is  equivalent  to 

(5.6)  ]T(2-'I»I  |M/)ff„||4)£  <  °o. 

S  n  eus 


The  above  relation  is  the  same  as  to  say  that  /  belongs  to  the  mixed  smoothness 
Besov  class  Thus  we  conclude  that  the  multivariate  classes  with  mixed 

smoothness  are  natural  for  studying  nonlinear  to- term  approxmation  with  regard  to 
a  basis  which  is  a  tensor  product  of  univariate  bases.  There  is  an  extensive  literature 
in  approximation  theory  on  function  classes  with  mixed  smoothness.  For  the  linear 
theory  see  [Tel],  [Te2]  and  for  some  results  in  nonlinear  m-term  approximation  see 
[T4]  and  [T6]. 
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